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Abstract 

Existing definitions of tlie relativizations of NC^, L and NL do not 
preserve tlie inclusions NC^ C L, NL C AC^. We start by giving the 
first definitions tliat preserve them. Here for L and NL we define their 
relativizations using Wilson's stack oracle model, but limit the height of 
the stack to a constant (instead of log(n)). We show that the collapse 
of any two classes in {AC°(m), TC", NC^, L, NL} implies the collapse 
of their relativizations. Next we exhibit an oracle a that makes AC'°(a) 
a proper hierarchy. This strengthens and clarifies the separations of the 
relativized theories in [Takeuti, 1995]. The idea is that a circuit whose 
nested depth of oracle gates is bounded by k cannot compute correctly the 
(fc + 1) compositions of every oracle function. Finally we develop theories 
that characterize the relativizations of subclasses of P by modifying theo- 
ries previously defined by the second two authors. A function is provably 
total in a theory iff it is in the corresponding relativized class, and hence 
the oracle separations imply separations for the relativized theories. 

1 Introduction 

Oracles that separate P from NP and oracles that collapse NP to P have both 
been constructed. This rules out the possibility of proofs of the separation or 
collapse of P and NP by methods that relativize. However, similar results have 
not been estabhshed for subclasses of P such as L and NL. Indeed, prior to 
this work there has not been a satisfying definition of the relativized version of 
NL that preserves simultaneously the inclusions. 

NC^ C L C NL C AC^ (1) 

(In this paper NC'^ and AC'' refer to their uniform versions.) For exam- 
ple [LL76j if the Turing machines are allowed to be nondeterministic when 
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writing oracle queries, then there is an oracle a so that NL(a) % P(q;). Later 
definitions of NL(a) adopt the requirement specified in |RST84] that the nonde- 
terministic oracle machines be deterministic whenever the oracle tape (or oracle 
stack) is nonempty. Then the inclusion NL(a) C P(q:) relativizes, but not all 
inclusions in ([T}. 

Because the nesting depth of oracle gates in an oracle NC^ circuit can 
be bigger than one, the model of relativization that preserves the inclusion 
NC^ C L must allow an oracle logspace Turing machine to have access to more 
than one oracle query tape |Orp83[ IBus86[ IWilSS) . For the model defined by 
Wilson |Wil88| . the partially constructed oracle queries are stored in a stack. 
The machine can write queries only on the oracle tape at the top of the stack. It 
can start a new query on an empty oracle tape (thus pushing down the current 
oracle tape, if there is any), or query the content of the top tape which then 
becomes empty and the stack is popped. 

Following Cook jCoo85| . the circuits accepting languages in relativized NC^ 
are those with logarithmic depth where the Boolean gates have bounded fanin 
and an oracle gate of m inputs contributes log(m) to the depths of its parents. 
Then in order to relativize the inclusion NC^ C L, the oracle logspace machines 
defined by Wilson |Wil88| are required to satisfy the condition that at any time, 

fc 

Y,max{log{\q,\),l} = 0{\og{n)) 
1=1 

where gi, 52, • ■ • , 9fe are the contents of the stack and \qi\ are their lengths. For 
the simulation of an oracle NC^ circuit by such an oracle logspace machine the 
upper bound O(log(n)) cannot be improved. 

Although the above definition of L(q;) (and NL(q;)) ensures that NC\a) C 
L(a), unfortunately we know only that NL(q;) C AC^(q;) |Wil88) : the inclusion 
NL(a) C AC^(a) is left open. 

We observe that if the height of the oracle stack is bounded by a constant 
(while the lengths of the queries arc still bounded by a polynomial in the length 
of the inputs), then an oracle NL machine can be simulated by an oracle AC^ 
circuit, i.e., NL(a) C AC^(a). In fact, it can then be shown that NL(a) 
is contained in the AC°(a) closure of the Reachability problem for directed 
graphs, while L(a) equals the AC°(a) closure of the Reachability problem for 
directed graphs whose outdegree is at most one. 

The AC" (a) closure of the Boolean Sentence Value problem (which is AC° 
complete for NC^) turns out to be the languages computable by uniform oracle 
NC^ circuits (defined as before) where the nesting depth of oracle gates is now 
bounded by a constant. We redefine NC^(q!) using this new restriction on the 
oracle gates; the new definition is more suitable in the context of AC°(a) re- 
ducibility (the previous definition of NC^(a) seems suitable when one considers 
NC"'^(q!) reducibility). Consequently, we obtain the first definition of NC^(q!), 
L{a) and NL(a) that preserves the inclusions in ([ij. 

Furthermore, the AC°-complete problems for NC^, L, and NL (as well 
as AC°(to), TC") become AC°(Q;)-complete for the corresponding relativized 
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classes. Therefore the existence of any oracle that separates two of the men- 
tioned classes implies the separation of the respective nonrelativized classes. (If 
the non-relativised classes would be equal, their complete problems would be 
equivalent under AC^-reductions, hence even more under AC°(a)-reductions 
and therefore the relativised classes would coincide as well.) Separating the rel- 
ativized classes is as hard as separating their nonrelativized counterparts. This 
nicely generalizes known results |Wil881 ISim771 IWil87) . 

On the other hand, oracles that separate the classes AC'^ (for /c = 0, 1, 2, . . .) 
and P have been constructed [Wil87| . Here we prove a sharp separation between 
relativized circuit classes whose nesting depths of oracle gates differ by one. 
More precisely, we show that a family of uniform circuits with nesting depth 
of oracle gates bounded by k cannot compute correctly the {k + 1) iterated 
compositions 

/(/(•■■/(O)...)) (2) 

for all oracle function /. (Clearly ^ can be computed correctly by a circuit 
with oracle gates having nesting depth {k + 1).) As a result, there is an oracle 
a such that 

NL(a) C AC^(a) C AC2(a) C ... C P(a) (3) 

The idea of using ^ to separate relativized circuit classes is already present 
in the work of Takeuti |Tak95] where it is used to separate the relativized ver- 
sions of first-order theories TLS{a) and TAC'^{a). Here TLS and TAC are 
(single sorted) theories associated with L and AC^, respectively. Thus with 
simplified arguments we strengthen his results. 

Finally, building up from the work of the second two authors |CN101 INC05) 
we develop relativized two-sorted theories that are associated with the newly 
defined classes NC^(q!), L(a), NL(a) as well as other relativized circuit classes. 

The paper is organized as follows. In Section [2] we define the relativized 
classes and prove the inclusions mentioned above. An oracle that separates 
classes in ([3]) is shown in Section [31 In Section |3] we define the associated 
theories and show their separation using the oracle defined in Section [S] 

2 Small Relativized Classes 
2.1 Relativized Circuit Classes 

Throughout this paper, a denotes a unary relation on binary strings. 

A problem is in AC'' if it can be solved by a polynomial size family of 
Boolean circuits whose depth is bounded by 0{{\ognY) {n is the number of 
input bits), where A and V gates are allowed unbounded fanin. The relativized 
class AC''(a) generalizes this by allowing, in addition to (unbounded fanin) 
Boolean gates (->, A, V), oracle gates that output 1 if and only if the inputs to 
the gates (viewed as binary strings) belong to a (these gates are also called a 
gates) . 

In this paper we always require circuit families to be uniform. Our default 
definition of uniform is DLOGTIME, a robust notion of uniformity that has a 
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number of equivalent definitions |BIS90[ Ilmm99| . In particular, a language L C 
{0, 1}* is in (uniform) AC° iff it represents the set of finite models {1, . . . ,n} 
of some fixed first-order formula with an uninterpreted unary predicate symbol 
and ternary predicates which are interpreted as addition and multiplication. 

Here an AC" reduction refers to a 'Turing' style reduction. Thus a problem 
A is AC° reducible to a problem B if there is a uniform polynomial size constant 
depth family of circuits computing A, where the circuits are allowed to have 
oracle gates for B, as well as Boolean gates. 

Recall that TC'^ (resp. AC°(m)) is defined in the same way as AC", except 
the circuits allow unbounded fanin threshold (resp. modm) gates. 

Definition 1 (AC''(a), AC°(m,a), TC°(a)). For k > 0, the class AC'=(a) 
(resp. AC°(m,a), TC°{a)) is defined as uniform AC*^ (resp. AC°(m), TC°) 
except that unbounded fan-in a gates are allowed. 

The class NC'' is the subclass of AC'' defined by restricting the A and V 
gates to have fanin 2. Defining NC''(a) is more complicated. In |Coo85) the 
depth of an oracle gate with m inputs is defined to be log(TO). A circuit is an 
NC''(a)-circuit provided that it has polynomial size and the total depth of all 
gates along any path from the output gate to an input gate is ©((log n)'^). Note 
that if there is a mix of large and small oracle gates, the nested depth of oracle 
gates may not be ©((log n)'^~^). 

Here we restrict the definition further, requiring that the nested depth of 
oracle gates is ©((logn)'^"^). This restriction allows us to show that in the 
relativized world, NC^ is still contained in L, and that the circuit value problem 
(for oracle NC'^ circuits) is still complete for NC'"' as expected. 

Definition 2 (NC'"(a)). For k > I, a language is in NC'^(q:) if it is computable 
by a uniform family o/NC'^(a) circuits, i.e., AC'^la) circuits where the A and 
V gates have fanin 2, and the nested depth of a gates is O{{\ogn)'^~^). 

The following inclusions extend the inclusions of the nonrelativized classes: 

AC°(a) C AC°{m, a) C TC"(a) C -NC\a) C AC^{a) C...C F{a) 

Further the AC"-coniplete problems for AC°(m), TC°, and NC^ are also 
AC'^(a)-complete for the corresponding relativized classes. This is expressed by 
the next result, using the following complete problems: MODto and THRESH 
(the threshold function) are AC'^-complete for AC°(m) and TC" respectively, 
and FORMVAL (the Boolean formula value problem) is both AC°-complete and 
AC'^-many-one complete for NC^. 

Proposition 3. 



AC°(m,a) 
TC°(a) 
NC^(a) 



AC°(MODTO,a) 

AC°(THRESH,a) 

AC°(FORMVAL,a) 



(4) 
(5) 
(6) 
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Proof. Each class on the right is included in the corresponding class on the left 
because a query to the complete problem can be replaced by a circuit computing 
the query. Each class on the left is a subset of the corresponding class on the 
right because the queries to a on the left have bounded nesting depth. □ 

Note that there is no similar characterization of AC^(a) or P{a), because 
here the queries to a can have unbounded nesting depth. 

2.2 Relativized Logspace Classes 

To define oracle logspace classes, we use a modification of Wilson's stack model 
|Wil88) . An advantage is that the relativized classes defined here are closed 
under AC°-reductions. This is not true for the non-stack model. 

A Turing machine M with a stack of oracle tapes can write or 1 onto the 
top oracle tape if it already contains some symbols, or it can start writing on an 
empty oracle tape. In the latter case, the new oracle tape will be at the top of 
the stack, and we say that M performs a push operation. The machine can also 
pop the stack, and its next action and state depend on a{Q), where Q is the 
content of the top oracle tape. Note that here the oracle tapes are write-only. 

Instead of allowing an arbitrary number of oracle tapes, we modify Wilson's 
model by allowing only a stack of constant height (hence the prefix "cs" in 
csL(a) and csNL(a)). This places the relativized classes in the same order as 
the order of their unrelativized counterparts. 

In the definition of csNL(a), we also use the restriction |RST84) that the 
machine is deterministic when the oracle stack is non empty or when it is in a 
push state. 

Definition 4 (csL(a), csNL(a)). For a unary relation a on strings, csL(a) is 
the class of languages computable by logspace, polytime Turing machines using 
an a-oracle stack whose height is bounded by a constant. csNL(a) is defined 
as csL(a) but the Turing machines are allowed to be nondeterministic when the 
oracle stack is empty. 

Theorem 5. NC^(a) C csL(a) C csNL(a) C AC\a). 

Proof. The second inclusion is immediate from the definitions, the first can be 
proved as in the standard proof of the fact that NC"'^ C L (see also [WilSSj ). 
The last inclusion can actually be strengthened, as shown in the next theorem. 
□ 

The next theorem partly extends Proposition[3]to the two new classes. Recall 
that STCONN is the problem: given {G,s,t), where s,t are two designated 
vertices of a directed graph G, decide whether there is a path from s to t. We 
define 1-STCONN to be the same, except we require that every node in G has 
out degree at most one. Then STCONN and 1-STCONN are AC°-many-one 
complete for NL and L, respectively. 
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A csL(q:) function is defined by allowing the csL(q!) machine to write on 
a write-only output tape. Then the notion of many-one csL(a) reducibility is 
defined as usual. 

Theorem 6. (i) csL(a) = AC°(1-STC0NN, a) 

(ii) csNL(a) C AC"(STCONN, a) 

(iii) A language is in csNJj{a) iff it is many-one csL(a) -reducible to STCONN. 

Proof. We start by proving the inclusion AC'^(1-STC0NN, a) C csL(a) in (i). A 
problem in AC°(1-STC0NN, a) is given by a uniform polynomial size constant 
depth circuit family {C„}„eN with oracle queries to 1-STCONN and a. A csL(a) 
machine M on an input x of length n performs a depth-first search of the circuit 
Cn with input x. Each a oracle gate at depth k is answered using an oracle 
query at stack height k, and each oracle query to 1-STCONN is answered by a 
log-space computation. 

Note that this argument does not work for the corresponding inclusion in 
(ii), because once the oracle stack is nonempty a csNL(q!) machine becomes 
deterministic and cannot answer oracle queries to STCONN (assuming L ^ NL). 

Now we prove the inclusion (ii). (The corresponding inclusion in the equation 
(i) is proved similarly.) Let M be a nondeterministic logspace Turing machine 
with a constant-height stack of oracle tapes. Let h be the bound on the height 
of the oracle stack. There is a polynomial p{n) so that for each input length n 
and oracle a, M has at most p{n) possible configurations: 

UQ = START, ui = ACCEPT, U2,..., Up(„)-i (7) 

Here a configuration Ui encodes information about the internal state, the content 
and head position of the work tape, and the position of the input tape head, 
but no explicit information about the oracle stack (although the internal state 
might encode implicit information). 

Given an input x of length n we construct a sequence Gq, - • ■ , Gh of directed 
graphs such that the set 14 of nodes in Gk consists of all pairs {k,u), where u 
is a configuration and k is the current height of the oracle stack (so < A; < /i). 
Thus {k,u) represents a 'height k configuration'. Note that the computation of 
M on input x can be described by a sequence of nodes in [J^ 14 • We want to 
define the edge set Ek so that 

{{k,u), {k,u')) e Ek iff {k,u') can be the next height k configuration after {k,u) 

(8) 

The edges E}. in Gk comprise the union 

Ek = e1\j eI 

Define E^ to consist of all pairs {{k,u), (k,u')) such that u does not cause a 
push or pop and u' is a possible successor to u. If fc > 1 then we also require 
that u be a deterministic configuration. 
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Define El to be empty if fc = ft,, and if < fc < /i then consists of all 
pairs ((fc, u), (fc, u')) such that m is a deterministic configuration causing a push, 
and there is a sequence 

{k + l,vo),...,{k + l,Vt) (9) 

of configurations such that vq is the successor of u and ((fc + 1, Vi), (fc+1, Wi+i)) & 
Ek+i for < i < f and Vt causes a pop and u' is the successor of Vt (given that 
{k,u) is the most recent level fc node preceding {k + l,Vt)). 

Note that in a computation from {k,u) to {k,u') the sequence ^ is the 
sequence of height fc + 1 nodes, and this sequence determines the string Q that 
is written on the the height fc+1 oracle tape, and hence determines whether u' 
is the successor of vt ■ 

It is easy to prove ([5]) by induction on fc ~ h, h — 1, . . . ,0. For fc = 
this implies that M accepts x iff there is a path in Go from (0, START) to 
{0, ACCEPT). Thus it suffices to show that some AC°(STCONN, a) circuit 
computes the adjacency matrix of each graph Gk given the input x. In fact it 
is easy to see that some AC^ circuit with input x outputs the adjacency matrix 
for each edge set E^. Hence it suffices to show that some AC°(STCONN, a) 
circuit computes the adjacency matrix for Ej. given input x and the adjacency 
matrix for El_^_^, < k < h. This can be done since the the elements for the 
sequence ^ can be obtained from Ek+i using oracle queries to STCONN, and 
the string Q that is written on the the height fc + 1 oracle tape can be extracted 
from this sequence using an AC*^ circuit, and so a{Q) can be used to determine 
u' is the successor of vt- 

Note that the depth of nesting of oracle calls to a is h. 

To prove (iii) we note that the direction (<^) is easy: A csNL(a) machine M 
on input x answers the single query f{x,a) to STCONN by simulating the NL 
machine M' that answers the query on input f{x, a), and each time M' requires 
another input bit, M deterministically computes that bit. 

To prove (iii) in the direction (^) we note that the edge relation Eq defined 
in the proof of (ii) can be computed by an csL(a) machine. Then as noted 
above, M accepts its input x iff there is a path in Go from (0, START) to 
{0, ACCEPT), which is an instance of STCONN. □ 

Corollary 7. The existence of an oracle a separating any two of the classes 

AC°(m,a) C TC°(a) C NC^a) C csL(a) C csNL(a) 
implies the separation of the respective nonrelativized classes. 

Proof. This follows from Proposition [3] and Theorem |6] parts (i) and (ii) . If 
any two of the nonrelativized classes is equal, then the corresponding complete 
problems would be AC'^-equivalent, and hence the relativized classes would be 
equal. □ 

Corollary 8 (Relativized Immerman-Szelepcsenyi Theorem). csNL(a) is closed 
under complementation. 
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Proof. By Theorem ^ (iii) any language in co-csNL(q!) is many-one csL(a) 
reducible to STCONN, which is many-one AC" reducible to STCONN. So 
co-csNL(a) C csNL(a). □ 

Let csL^(a) denote the class of languages computable by a deterministic 
oracle Turing machine in O(log^) space and constant-height oracle stack. 

Corollary 9 (Relativized Savitch's Theorem). csNL(a) C csL^(a). 

Proof. The corollary follows from Theorem [5] (iii) and the fact that the com- 
position of a csL(a) function and a (log^) space function (for STCONN) is a 
csL^(a) function. □ 

It is easy to see that the function class associated with either of the classes 
AC°(1-STC0NN ,a) or AC"(STCONN, a) is closed under composition, so we 
have the following result. 

Corollary 10. The function class associated with csL(a) is closed under com- 
position. 

However it is an open question whether the function class associated with 
csNL(a) is necessarily closed under composition, for the same reason that we 
cannot necessarily conclude that inclusion in part (ii) of Theorem [5] can be 
changed to equality. Once the oracle stack in a csNL(a) machine becomes 
nonempty it becomes deterministic, so it is not clear that the machine can solve 
an STCONN problem. 



3 Separating the AC^ Hierarchy 

One of the obvious benefits of considering relativized complexity classes is that 
separations are at hand. Even though the unrelativized inclusion of AC"'^ in the 
polynomial hierarchy is strongly conjectured to be strict, no proof is currently 
known. On the other hand Wilson |Wil87] showed the existence of an oracle 
aw which makes the relativized AC'^-hierarchy is strict. Here we reconstruct a 
technique used by Takeuti [Tak95] to separate theories in weak bounded arith- 
metic and use it to give a simpler definition of an oracle a separating the AC*^ 
hierarchy. In the next section we show how to use this result together with a 
witnessing theorem to obtain an unconditional separation of relativized theories 
capturing the AC'' hierarchy. 

The idea is that computing the k'th iterate 7*^(0) = /(/(. . . /(O))) of a func- 
tion / is essentially a sequential procedure, whereas shallow circuits represent 
parallel computation. So a circuit performing well in a sequential task has to 
be deep. To avoid the fact that the sequential character of the problem can be 
circumvented by precomputing all possible values, the domain of / is chosen big 
enough; we will consider functions /: {0, 1}" {0, 1}". 

Of course with such a big domain we cannot represent such functions simply 
by a value table. That's how oracles come into play: oracles allow us to provide 
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a predicate on strings as input, without the need of having an input bit for 
every string. In fact, the number of bits potentiahy accessible by an oracle gate 
is exponential in the number of its input wires. 

Therefore we represent the i'th bit of f{x) for x G {0, 1}" by whether or not 
the string xi belongs to the language of the oracle. Here i is some canonical 
coding of the natural number i using logn0 bits. 

Our argument can be summarized as follows. We assume a circuit of depth d 
(i.e., the circuit has d levels) is given that supposedly computes the -^'th iterate 
of any function / given by the oracle. Then we construct, step by step, an oracle 
that fools this circuit, if £ > d. To do so, for each layer of the circuit we decide 
how to answer the oracle questions, and we do this in a way that is consistent 
with the previous layers and such that all the circuit at layer i knows about / 
is at most the value of /*(0). To make this step- by-step construction possible 
we have to consider partial functions during our construction. 

If A and B are sets we denote by / : A ^ B that / is a partial function from 
A to B. In other words, / is a function, its domain dom(/) is a subset of A and 
its range rng(/) is a subset of B. 

Definition 11. A partial function /: {0, 1}" {0, 1}" is called (-sequential if 
for some fc < £ it is the case that 0, /(O), P{0), ■ ■ ■ , /'^(O) are all defined, but 
/fc(0)^dom(/). 

Note that in DefinitionlTTjit is necessarily the case that 0, /(O), /^(O), . . . , /'"(O) 
are distinct. 

Lemma 12. Let n € N and f: {0,1}" ^ {0,1}" be an (-sequential partial 
function. Let M C {0, 1}" he such that |dom(/) U M| < 2". Then there is an 
{£ -\- l)-sequential extension f ^ f with dom(/') = dom(/) U M. 

Proof. Let a G {0, 1}" \ {M U dom(/)). Such an a exists by our assumption on 
the cardinality of M U dom(/). Let /' be / extended by setting f'{x) = a for 
all X € M \ dom(/). This /' is as desired. 

Indeed, assume that 0, /'(O), . . . , /'^+H0), /'^+2(0) are aU defined. Then, 
since a ^ dom(/'), all the 0, f {0), . . . , f'^~^^{0) have to be different from a. 
Hence these values have already been defined in /. But this contradicts the 
assumption that / was ^-sequential. □ 

Definition 13. To any natural number n and any partial function / : {0, 1}" ^ 
{0, 1}" we associate its bit graph f3n.f as a partial function /3„j : {0, i}"+i°g" ^ 
{0, 1} in the obvious way. More precisely, (5n,f{xv) is the i'th bit of f{x) if f{x) 
is defined, and undefined otherwise, where w is a string of length logrt coding 
the natural number i. 

If /: {0, 1}" {0, 1}" is a total function, we define the oracle a/ by 

af{w) O Pn.j{w) = 1- 

^We use logn to stand for [log2(rj -(- 1)]. 



9 



Thus af{w) can only hold for strings w of length n + \ogn. 
Immediately from Definition[T3]we note that / can be uniquely reconstructed 
from Uf. If a is an oracle, we define a^"! by 

^ {a{w) A\w\ + logn), 

so has finite support. 

In what follows, circuits refer to oracle circuits as discussed in Section \2A\ 
We are mainly interested in circuits with no Boolean inputs, so the output 
depends only on the oracle. 

Theorem 14. Let C be any circuit of depth d and size strictly less then 2". 
If C{a) correctly computes the last bit of f^{0) for the (uniquely determined) 
f : {0, 1}" {0, 1}" such that af — a'"', and this is true for all oracles a, then 

e<d. 

Proof. Assume that such a circuit computes /^(O) correctly for all oracles. We 
have to find an oracle that witnesses £ < d. First fix the oracle arbitrarily on 
all strings of length different from n + logn. So, in effect we can assume that 
the circuit only uses oracle gates with n + logn inputs. 

By induction on fc > we define partial functions fk ■ {0, 1}" ^ {0, 1}" with 
the following properties. (Here we number the levels of the circuit 0,1,..., d—1.) 

• /o C /i C /2 C . . . 

• The size |dom(/fe)| of the domain of fk is at most the number of oracle 
gates in levels strictly smaller than k. 

• Pnjk determines the values of all oracle gates at levels strictly smaller 
than k. 

• fk is fc-sequential. 

We can take fo to be the totally undefined function, since /"^(O) = by defini- 
tion, so /o is 0-sequential. As for the induction step let M be the set of all x of 
length n such that, for some i < n, the string xi is queried by an oracle gate at 
level k and let fk+i be a fc+l-sequential extension of fk to domain dom(/fc) UM 
according to Lemma [121 

For k = d we get the desired bound. As /?„ already determines the values 
of all gates, the output of the circuit is aheady determined, but f'^^^{0) is still 
undefined and we can define it in such a way that it differs from the last bit of 
the output of the circuit. □ 

Inspecting the proof of Theorem [T3] we note that it does not at all use what 
precisely the non-oracle gates compute, as long as the value only depends on 
the input, not on the oracle. In particular, the proof still holds if we consider 
subcircuits without oracle gates as a single complicated gate. Thus we have the 
following corollary of the above argument and part (ii) of Theorem [6l 
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Corollary 15. csNL(a) can iterate a function given by an oracle only con- 
stantly far. In particular, there exists a such that csNL(a) is a strict subclass 
0/ AC 1(a). 

Having obtained a lower bound on the depth of an individual circuit, it is a 
routine argument to separate the corresponding circuit classes. In other words, 
we are now interested in finding one oracle that simultaneously witnesses that 
the AC'^(a)-hierarchy is strict. For the uniform classes this is possible by a 
simple diagonalization argument; in fact, the only property of uniformity we 
need is that there are at most countably many members in each complexity 
class. So we will use this as the definition of uniformity. It should be noted that 
this includes all the known uniformity notions. 

Definition 16. If g: N — > N is a function from the natural numbers to the 
natural numbers, and a is an oracle, we define the language 

^{x\ the last bit of /^("'(O) is 1, 

where n — \x\ and / is such that a/ = a'"'} 

We note that in Definition \W\ the function / is uniquely determined by the 
length n of X and the restriction of a to strings of length n + logn. Also, for 
logspace-constructible g the language Cg can be computed by logspace-uniform 
circuits (with oracle gates) of depth g{n) and size n ■ g(n). 

Recall that a circuit family is a sequence {Cn}n£N of circuits, such that Cn 
has n inputs and one output and may have oracle gates. The language of a 
circuit family {C„}„gN with oracle a is the set of all strings x G {0, 1}* such 
that the output of C\x\{oi) with input x is 1. 

Definition 17. A notion of uniformity is any countable set U of circuit families. 

Let W be a notion of uniformity, and let d,s:N N be functions. The 
Z//-uniform (d, s)-circuit families are those circuit families {C„}„gN of U such 
that Cn has oracle nested depth at most d{n) and size at most s(n). 

We use a diagonal argument to obtain the following theorem. 

Theorem 18. Let U be a notion of uniformity and let {dk}k£N be a family of 
functions such that for all k ^ N the function dk+i eventually strictly dominates 
dk- Moreover, let {sfcjfegN be a family of strictly subexponentially growing func- 
tions. Then there is a single oracle a that simultaneously witnesses that for all 
k, ^di.+i cannot be computed by any lA-uniform {0{dfS),0{sk))- circuit family. 

Proof. Let , C^, ... be an enumeration oilA. Let {ki, Ci, mi) be an enumeration 
of all triples of natural numbers. 

We will construct natural numbers Ui, and oracles such that the following 
properties hold. 

• The Ui strictly increase. 

• ai{w) holds at most for strings w of length Ui + log rii. 
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• If C"' = {C™' }neN and C™' has oracle depth at most q • dfc. (n^) and size 
at most Ci ■ Skiirii) then the language of C™' with oracle \l j^^^Cij differs 

from ' at some string of length n,;, and C™' contains no oracle 

gates with n^+i + logn^+i or more inputs. 

Then will be the desired oracle a. For suppose otherwise. Then there 

is k and a {0{dk),0{sk)) circuit family C™ such that C™ with oracle a com- 
putes ^'d^_^_i- Hence there is a triple {ki,Ci,mi) such that the circuit C™' has 
oracle depth at most ct ■ dfc. (n^) and size at most Ci ■ Ski{ni) and C^*(a) cor- 
rectly computes C^^ ^ on inputs of length Ui. But this contradicts the above 
properties. 

At stage i take big enough so that it is bigger than all the previous n^'s 
and rii + log Ui is bigger than the maximal fan- in of all the oracle gates in all the 
circuits looked at so far; moreover take ni big enough such that Ci ■ Sk^ {ui) < 2"' 
and Ci • dki(ni) < dki+i{ni). This is possible as has strictly subexponential 
growth and dk^+i dominates dfc. eventually. 

Look at the n^'th circuit in the circuit family C™', and call it C. We may 
assume that C has oracle depth at most q • dk^irii) and size at most Ci ■ Ski{ni) 
for otherwise there is nothing to show and we can choose ai to be the empty 
set. 

By Theorem [14] we can find an oracle Ui whose support includes only strings 
of length Tii + log rii such that C with oracle Vj<i '^i <^oes not solve the decision 
problem associated with /''fci+i^"*) (0) for / given by a/ — ai. □ 

Corollary 19. There is a single oracle a C {0, 1}* for which 

AC^{a) C NC'^'+^(a) C AC'^+^a), for all k > I (10) 
and csNL(a) C A&{a). 

Proof. In Theorem [18] let U be log space uniformity and let dk (n) = log'^ n and 
Skin) = 2l^"/^l. Then for fc > 1, every problem in AC'^(a) can be computed by 
a W-uniform (©(d/c), C'(sfe))-circuit family with oracle a, and C^^ AC'^(a). 
Then Theorem [T5I shows that there is a single oracle a satisfying pUj) . 

To show csNL(a) C AC^(a), by Theorem [B] part (ii), it suffices to show 

£:^^ ^ AC°(STCONN,a). (11) 

Theorem [T5I shows how to construct a so C^^ ^ AC'^{a), and we can modify the 
proof by starting with a which is a version of STCONN in which no string has 
length n + logn for any n. The result of the construction in the proof satisfies 
p!]) as weU as ([TO]). □ 
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4 Theories for Relativized Classes 



4.1 Two-Sorted Languages and Complexity Classes 

Our theories are based on a two-sorted vocabulary, and it is convenient to re- 
interpret the complexity classes using this vocabulary [CNlOi INC05| . Our two- 
sorted language has variables x,y, z, ... ranging over N and variables X,Y, Z., ... 
ranging over finite subsets of N (interpreted as bit strings). Our basic two-sorted 
vocabulary £\ includes the usual symbols 0, 1, +, •, =, < for arithmetic over N, 
the length function \X\ on strings, the set membership relation G, and string 
equality —2 (where we usually drop mention of the subscript 2). The function 
\X\ denotes 1 plus the largest element in the set X, or if X is empty (roughly 
the length of the corresponding string). We will use the notation X{t) ior t G X, 
and we will think of X{t) as the t-th. bit in the string X. 

Number terms of £^ are built from the constants 0,1, variables x,y,z,..., 
and length terms \X\, using -I- and •. The only string terms are string variables 
X,Y,Z,.... The atomic formulas are t = u, X = Y,t<u, tizX for any number 
terms t, u and string variables X, Y. Formulas are built from atomic formulas 
using A, V, -I and both number and string quantifiers 3x, 3X, Va;, VX. Bounded 
number quantifiers are defined as usual, and the bounded string quantifier 
3X <t if stands for 3X(|X| < tAip) and yX <tip stands for VX(|X| <tD ip), 
where X does not occur in the term t. 

YIq is the set of all £^-formulas in which all number quantifiers are bounded 
and with no string quantifiers. Sf (corresponding to strict S}''' in |Kra95) ) 
formulas begin with zero or more bounded existential string quantifiers, followed 
by a "Eq formula. These classes are extended to , i >2, (and Ilf , i > 0) in 
the usual way. 

We use the notation S^(i2) to denote formulas which may have two- 
sorted function and predicate symbols from the vocabulary C in addition to the 
basic vocabulary C\. 

Two-sorted complexity classes contain relations R{x, X) (and possibly number- 
valued functions f{x,X) or string-valued functions F{x,X)), where the argu- 
ments X — xi, . . . ^Xk range over N, and X = Xi, . . . , X^ range over finite sub- 
sets of N. In defining complexity classes using machines or circuits, the number 
arguments Xi are presented in unary notation (a string of Xi ones), and the 
arguments Xi are presented as bit strings. Thus the string arguments are the 
important inputs, and the number arguments are small auxiliary inputs useful 
for indexing the bits of strings. 

As mentioned before, uniform AC'^ has several equivalent characterizations 
|Imm99] . including LTH (the log time hierarchy on alternating Turing ma- 
chines) and FO (describable by a first-order formula using predicates for plus 
and times) . Thus in the two-sorted setting we can define AC° to be the class of 
relations R{x,X) such that some alternating Turing machine accepts R in time 
O(logn) with a constant number of alternations, using the input conventions 
for numbers and strings given above. Then from the FO characterization of 
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AC we obtain the following nice connection between the classes AC and NP 
and our two-sorted >C^-formulas (see Theorems IV. 3. 6 and IV. 3. 7 in |CN1Q| ). 

Theorem 20 (Representation Theorem). A relation R{x,X) is in AC° (resp. 
NPJ iff it is represented by some (resp. Sf j formula Lp{x,X). 

In general, if C is a class of relations (such as AC°) then we want to associate 
a class FC of functions with C. Here FC will contain string- valued functions 
F(x,X) and number- valued functions f{x,X). We require that these functions 
be ^7-bounded; i.e. for each F and / there is a polynomial g{n) such that 
\F{x,X)\ < g{max{x,\X\)) andf{x,X) < g{max{x,\X\)). 

We define the bit graph Bpii, x, X) to hold iff the ith bit of F{x, X) is one. 
Formally 

Bpii, X, X) o F{x, X){i) (12) 
(Compare this with Definition fOl) 

Definition 21. IfC is a two-sorted complexity class of relations, then the cor- 
responding function class FC consists of all p-bounded number functions whose 
graphs are in C, together with all p-bounded string functions whose bit graphs 
are in C. 

For example, binary addition F^{X,Y) = V + y is in FAC°, but binary 
multiplication Fx (X, Y) = X ■ Y is not. 

Definition 22. A string function is S^-definable from a collection L of two- 
sorted functions and relations if it is p-bounded and its bit graph is represented 
by a (C) formula. Similarly, a number function is S^-definable from C if it 
is p-bounded and its graph is represented by a 5]^(£) formula. 

It is not hard to see that FAC° is closed under S^-definability, meaning that 
if the bit graph of F is represented by a S^(FAC") formula, then F is already 
m FAC". Of course the set of functions in FAC'^ is closed under composition, 
but for a general vocabulary C the set of functions S^-definable from C may 
not be closed under composition. For example if a relation a{Y) codes the bit 
graph of a function F then F could be S^-definable from C U {a} but F o F 
may not be. In order to define complexity classes such as AC°(m) and TC'', as 
well as relativized classes such as AC°(q;), we need to iterate S^-definability 
to obtain the notion of AC° reduction. 

Definition 23. We say that a string function F (resp. a number function f) is 
AC'^ -reducible to C if there is a sequence of string functions Fi, . . . , F„ (n>0) 
such that 

Fi is -definable from jC U {Fi, . . . , Fi_i}, for i = 1, . . . ,n] (13) 

and F (resp. f) is -definable from jC U {Fi, . . . , Fn}. A relation R is AC'^- 
reducible to C if there is a sequence Fi, . . . , F„ as above, and R is represented 
by aT,^[C{J {Fi, . . . , F„}) formula. 
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If F and G are string-to-string functions in C then the term F{G{X)) can 
appear in 11q{C) formulas, so the set of functions AC°-reducible to C is always 
closed under composition. In fact from the techniques used to prove Theorem l20l 
we can show that F is AC°-reducible to C iff there is a uniform constant-depth 
polysize circuit family that computes F, where the circuits are allowed gates 
(each of depth one) which compute the functions and predicates in C (as well 
as the Boolean connectives). 

The (two-sorted) classes AC°(m), TC", NC\ L and NL are the closure 
under AC°-reductions of their respective complete problems, so they become 
AC"(MODm), AC°(THRESH), AC"(FORMVAL), AC°(1-STC0NN) and AC"(STCONN). 
The relativized versions AC°(a), AC°(m,a), TC°(a), NC''(a), and AC''(a) 
of the circuit classes are all closed under AC°-reductions, and so is csL(a) 
(Theorem [6] part (i)), but csNL(a) may not be so closed. 

4.2 Nonrelativized Theories 

In this paper we consider theories T over two-sorted vocabularies which contain 

Definition 24. If F{x, X) is a string function, we say that F is -definable 
(or provably totalj in T if there is a formula (p{x, X ,Y) which represents 
the graph of F and 

Th3lYip{x,X,Y) 
where 3\Y means there exists a unique Y . 

A similar definition applies to for number functions /(a;, X). When we asso- 
ciate a theory T with a complexity class C we want the provably total functions 
in T to coincide with the functions in FC. 

The theory V" (essentially Sg-comp in |Zam96) . and ISp'^ (without #) in 
|Kra95| ) is the theory over C\ that is axiomatized by the axioms listed in Figure 
[T] together with the comprehension axiom scheme S^-COMP, i.e. the set of 
all formulas of the form 

3X < yiz < y{X{z) o ip{z)), (14) 

where (p{z) is any formula in S^, and X does not occur free in (p{z). 

We associate V° with the complexity class AC°, and indeed the provably 
total functions of V° comprise the class FAC°. All theories considered in this 
paper extend V°. 

In [CNlOi Chapter IX], for various subclasses C of P, a theory VC is de- 
veloped which is associated with C as above, so the provably total functions of 
VC are precisely those in FC. Essentially, the theory VC is axiomatized by 
the axioms of V*' together with an axiom that states the existence of a polytime 
computation for a complete problem of C, assuming the parameters as given 
inputs. The additional axioms for the classes of interest in this paper will be 
listed below. For the logspace classes (i.e., AC°(to), . . . , NL) we use roughly the 
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same problems as those mentioned in the previous sections. For other classes in 
the AC hierarchy we use the monotone circuit value problem, with appropriate 
restrictions on the depth and fanin of the circuits. 

To formulate these axioms we introduce the pairing function (y,z), which 
stands for the term {y + z){y + z + 1) + 2z. This allows us to interpret a string 
X as a two-dimensional bit array, using the notation 

X{y,z) = X{{y,z)) (15) 

For example, a graph with a vertices can be encoded by a pair (a, E) where 
E{u, v) holds iff there is an edge from u to v, for < u, w < a. 

We will also use the number function (Z)^ which is the x-th element of the 
sequence of numbers encoded by Z: 

y = {Zy ^ {y < \Z\ A Z{x, y) h'iz < y^Z{x, z))V 

i\/z<\Z\^Zix,z)Ay^\Z\) 

In addition, logo, or |a|, denotes the integral part of log2(a + 1). Note that 
these function is provably total in V°. Note also that the functions (2')^ and 
\a\ can be eliminated using their Hq defining axioms, so that Hq formulas 
that contain these functions are in fact equivalent to formulas over C\ (see 
ICNIO) Lemma V.4.15]). 

We now list the additional axioms for the classes considered in this paper. 
(Recall that the base theory is always V°.) First, consider TC°. The theory 
VTC° is axiomatized by the axioms of V" and the following axiom: 

NUMONES = ay < 1 + {x,x)5num{x,X,Y) 

where 

5num{x,X,Y)= {Yf = QA 

yz<x [{x{z) D {Yy+' = {Yy + 1) a (-x(z) d {Yy+^ = (yy)] 

Here NUMONES formalizes a computation of the number of 1-bits in the string 
X{0),X{l),...,X{x - 1): for 1 < z < X, {YY is the number of 1 bits in 
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X{0),X{1), . . . ,X{z — 1). (Note that computing the number of 1-bits in the 
input string is roughly the same as computing the threshold function.) 

Now consider AC°(rn). The additional axiom for the theory V°(m) associ- 
ated with AC*'(m) is 

M0D„, = 3YSmodAx,X,Y) 

where 

SmodA^.X,Y) = Y (0,0) A 
VzKx [{X{z) D {Yy+^ = {Yy + 1 mod m) A (-X(z) D {Yy+^ = (F)")] 

Similar to NUMONES above, here {YY is the number of 1-bits in the sequence 
X(0),...,X(z - 1) modulo m. 

For NC^, the additional axiom MFV for VNC^ states the existence of 
a polytime computation for the Balanced Monotone Sentence Value Problem 
which is complete for VNC^ jBusSTj: 

MFV = 3Y 5MFVp{a,G,I,Y) (16) 

where 

^MFVpia, G, I,Y) = Vx < a [Y{x + a) o I{x)A 

0<x D Y{x) ^ {{G{x) AY{2x) AY{2x + l))\' 

{^G{x) A {Y{2x) V Y{2x + 1)))) 

Here the balanced monotone sentence is viewed as a balanced binary tree en- 
coded by (a, G) and / specifies the leaves of the tree: node x's children are 2x 
and 2x + 1, G{x) indicates whether node a; is an V or A node, and I{z) is the 
value of leaf z. Y is the bottom-up evaluation of the sentence: Y{x) is the value 
of node x. 

Next, the theory VNL for NL is axiomatized by V° and the following axiom 

CONN = 3Y6coNN{a,E,Y) 

where Sconn{o-, E,Y) states that Y encodes a polytime computation for the 
following problem, which is equivalent to STCONN under AC'^-many-one re- 
ductions: on input (a, E) which encodes a directed graph, compute the nodes 
that are reachable from node 0. Here Y{z, x) holds iff there is a path from to 
X of length < z; more precisely, 

ScoNNia, E, Y) = r(0, 0) A Va; < a(x 7^ D -y(0, x)) A 

Vz < aVa; < a [Y{z + 1, a;) o {Y{z, x) V 3y < a, Y{z, y) A E{y, x))] . 

For L, the additional axiom in VL is PATH, which states the existence 
of a polytime computation for the following problem, which is equivalent to 
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1-STCONN under AC reductions: on input a directed graph with out degree 
at most one which is encoded by (a, E), compute the transitive closure of vertex 
0: 

PATH = Vx < a3ly < aE{x,y) D 

3P [(P)0 = A Vi; < a{{Py+^ < a A S((P)", (P)"+'))] 

{{P)" is the vertex of distance v from 0.) 

Now we consider the classes AC'' for fc > 1. We use the monotone cir- 
cuit value problem under an appropriate setting. In particular, the circuit has 
unbounded fanin, and its depth is (logn)'^, where n is the number of its in- 
puts. Thus the additional axiom in VAC'^ states the existence of a polytime 
evaluation Y for a circuit of this kind which is encoded by (a, E, G, I): 

3YSLMCv{a,\a\\E,G,I,Y) (17) 

where the depth parameter d is set to |a|'^ in the formula 

Slmcv{w, E, G, I, Y)=yx< wMz < d, {Y{0, x) o I{x)) A 

Y{z + 1, x) O [[G{z + l,x) AVu <w {E{z, u, x) D Y{z, u))]V 

[-^G{z + 1, x) A 3w < w {E{z, u, x) A Y{z, u))]] 

The formula SLMCv{w,d,E,G,I,Y) (Layered Monotone Circuit Value) states 
that Y is an evaluation of the circuit encoded by (w, d, E, G) on input /. The 
circuit is encoded as follows. There are (d+l) layers in the circuit, each of them 
contains w gates. Hence each gate is given by a pair {z,x) where z indicates 
the layer (inputs to the circuits are on layer and outputs are on layer d), and 
x is the position of the gate on that layer. E specifies the wires in the circuit: 
E{z,u,x) holds if and only if gate (z,u) is an input to gate (z -I- l,x), and G 
specifies the gates: G{z, x) holds if gate (z, x) is an A gate, otherwise it is an V 
gate. Bit Y{z,x) is the value of gate {z,x). 

For NC'^ {k > 2) the circuit value problem is restricted further, so that 
the circuit's fanin is at most 2. We express this condition by the formula 
Fanin2{w,d, E), where {w,d,E) encodes the underlying graph of the circuit 
as above: 

Fanin2{w, d, E) = Vz < dix < w3ui < w3u2 < wWv < w 

E{z, v,x) ^ {v = uiM V = U2) 

Similar to VAC*^, the theory VNC'^ (for A: > 2) is axiomatized by the axioms 
of V° together with 

[Fanin2{aM'',E) 3Y 5LMCv{a,\a\'' ,E,GJ ,Y)) (18) 

The connection between the above theories VAC*^ and VNC''' and their 
corresponding classes is discussed in detail in jCNlOi Section IX. 5. 6]. The key 
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point for these theories (as weh as the others) is that the problem of witnessing 
the existential quantifiers in the axiom for each theory (in this case ((T7| and 
(|18p) is complete for the associated complexity class. For AC*^ and NC*^ this 
is shown by using the characterization of these classes in terms of alternating 
Turing machines. 

In the remainder of this section we will present relativized theories VC(a) 
that characterize the relativized classes discussed in Section [2] 

4.3 Relativized Theories 

4.3.1 Classes with bounded nested oracle depth 

We first look at AC°(m,a), TC°(a), NC^(q;) and csL(a). These classes have 
constant nested depth of oracle gates, and they are the AC°-closure of the oracle 
a and an appropriate complete problem (see Proposition [3] and Theorem [6] (i) ) . 
We can treat these as the AC'^(a)-closure of the complete problem for their re- 
spective nonrelativized version. Thus the development in |CN10[ Chapters VIII 
and IX] can be readily extended to these classes. The change we need to make 
here is to replace the base theory V" by its relativized version, V''(a), which 
is axiomatized by comprehension axioms (ITil) over S^(a) formulas instead of 
just TiQ formulas. 

First note that a sequence of strings can be encoded using the string function 
Row, where Row{x, Z) extracts row x from the array coded by Z. Thus 

Row{x,Z){i) ^ i <\Z\ A Z{x,i) (19) 

We will also write Z^^l for Row{x, Z). 

Notation . For a predicate a we use C\{a) to denote C\ U {Row, a], and 
we use S^(a:) and Sf (a) to denote the classes S^(i?ow,a) and Sf (i?o?/;, a), 
respectively. Definitions [521 HSl and [M] of S^-definable, AC^-reducible, and 
Sf -definable in a theory, are extended in the obvious way to S^(a)-definable, 
AC°(a)-reducible, and Sf (Q!)-definable in a theory. 

Atomic formulas containing a have the form a{T), where T is a string term; 
namely either a variable X or a term Row{t,T') for terms t,T'. 

Notice that while the string function Row can occur nested in a S^(a) 
formula, the predicate a cannot. Thus a S^(a) formula represents relations 
computable by a family of polynomial size AC°(a) circuits whose oracle nested 
depth is one. 

The function Row is useful in constructing formulas describing circuits which 
query the oracle a. For example if an n-ary gate g has inputs from n different 
a gates, we can code the sequence of inputs to the a gates using a string X, so 
the ith input bit to g is a{X^^^). 

Definition 25. The following theories have vocabulary C\{a) and include the 
defining axiom (03) for Row. V°{a) = V° + S^(a)-COMP. The theories 
Y°{m,a), VTC°(a), VNC^(a) and VL(a), VNL'(a) are axiomatized by the 
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axioms 0/ V°(a) together with the axiom: MOD,n, NUMONES, MFV, PATH, 
CONN respectively. (See Section \4^ ) 

Note that equality axioms (implicitly) hold for the new symbols Row and a. 

The next result connects the theories with their corresponding complex- 
ity classes, except for the theory VNL'(a), which corresponds to the class 
AC"(STCONN,a) (see part (h) of Theorem O rather than csNL(a). We are 
not able to provide a theory exactly associated with csNL(a) because we cannot 
show that the associated function class is closed under composition. 

The first step in the proof of the next theorem is to show that a function 
is in FAC°(a) iff it is Sf (Q!)-definable in V°(a). For the direction (=>) the 
proof of the unrelativized case uses the Representation Theorem (Theorem 
[^D|) . but that result does not hold for the relativized case, because, as remarked 
above, S^(a) formulas only represent AC''(q;) relations that can be computed 
by circuits of oracle depth one. 

So results in Chapter IX of |CN10] are required. 

Theorem 26. For a class C in {AC°, AC°(m), TC°, NC\ £}, a function is 
in FC(a) if and only if it is 'Sf (a) -definable in VC(a). 

Proof. We start by proving this when C is AC'^: A function is in FAC°(a) iff 
it is Sf (a) -definable in V''(a). The 'if direction follows from a standard wit- 
nessing theorem (see for example Chapter V in [CNlOj ). because the existential 
quantifier in each S^(a)-COMP axiom is witnessed by an FAC°(a) function 
whose graph is represented by a (a) formula. 

The converse follows from a slight generalization of Theorem IX. 2. 3 in |CN10| . 
where the original states that a function is Sf -definable in VC iff it is in FC. 
That theorem applies to complexity classes C consisting of the relations AC"- 
reducible to a string function F{X) whose graph is represented by a S^-formula 
Sf{X, Y). The theory VC has vocabulary C\ and is axiomatized by the axioms 
of V° together with 

3Y < Wi < bSp {X , y ) . (20) 

The generalization we need (which is proved in the same way) is that the theory 
VC is replaced by a theory VC(a) with vocabulary C\{a) axiomatized by 
the axioms of Y°{a) and where now Sp{X,Y) is a S^(Q!)-formula. The 
assertion now is that a function is Sf (a)-definable in VC(a) iff it is in FC(a). 

To apply this to the theory V"(q!) we take F = Fa where Sf^{X,Y) is the 
formula |y| < \X\ A Vj < \X\{Y{j) o Q(Xbl)). Thus F„(X) is "the bit string 
resulting from applying a successively to the elements of the sequence of strings 
coded by X, and so the AC° closure of F^ is FAC°(a). The theory Y°{a) has 
the comprehension axiom S^(q:)-COMP, which implies (PU]) when F is taken 
to be Fa- Thus our generalized Theorem IX. 2. 3 in |CN10j implies that every 
function in FAC''(a) is Sf (a)-definable in V"(a). 

Theorem for the other complexity classes follows from Proposition [3] and 
Theorem[6] (i) and the fact that the theories for the nonrelativized classes capture 
the nonrelativized classes (Section 14. 2p . □ 
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The same argument shows that the theory V°(a) + CONN is associated 
with the class AC°(STCONN, a). But this class might not be the same as 
csNL(a). In fact, as pointed out after the proof of Corollary [TUl the function 
class associated with csNL(a) may not be closed under composition, and hence 
csNL(a) may not be closed under AC^-reductions, so the framework of [CNlOl 
Chapter IX] may not apply to this class. 

Notice also that we can relativize the axioms MOD^, NUMONES, MFV, 
and PATH in the obvious way, i.e., by replacing the string variables X in 
NUMONES and MOD,,,, G and / in MFV, and E in PATH by (a) for- 
mula(s). It turns out that these relativized axioms are provable in the respective 
relativized theories, and in fact they can be used together with V*^ to axiomatize 
the theories. More specifically, let NUMONES{a) denote the following axiom 
scheme: 

3Y <1 + {x,x) (Y)° = A 

Vz < X [{^{z) D = {YY + 1) A (^^(z) D {Yy+' = {Yf)] (21) 

for all Ti^ {a) formulas f that do not contain Y. Similarly we can define 
MOD,n{a), MFV (a), and PATH (a). 

The next result is useful in the next subsection. 

Proposition 27. VTC°(a) can be equivalently axiomatized by the axioms of 
VO and NUMONES (a). Similarly for V"{m, a), VNC^(a), and VL{a), with 
NUMONES{a) replaced respectively by MOD,n{a.), MFV{a), and PATH{a). 

Proof. We prove this for NUMONES {a). The other cases are similar. 

It is relatively simple to show that the axioms of NUMONES {a) are provable 
in VTC°(q;). Indeed, consider an axiom in NUMONES (a) as in above. 
By S^(a)-COMP, there is a string X such that X{z) O ip{z) for all z < x. 
Hence, the string Y that satisfies 6num{x,X,Y) satisfies (pij) . 

For the other direction, suppose that we want to prove the following instance 
of S^(a)-COMP using NUMONES (a) and V": 

3Z < b\/z < b, Z{z) o ifi{z) 

where tp is a formula. Using NUMONES (a) we obtain a string Y as in 

(PT|) (for x — b). Now, it is straightforward to identify those z < b such that 
(p{z) holds: 

ip{z) ^ (y)"+i = {YY + 1 

Thus Z can be defined using S^-COMP from Y. 

The arguments for V'^(m,a ), VNC^(a), and VL(a) are similar. □ 

4.3.2 Classes with unbounded oracle nested depth 

Now we present the theories VAC''(a) (for fc > 1) and VNC''(a) (for k > 2). 
For the nonrelativized case, the axioms for the theories use the fact that the 
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problem of evaluating an unbounded fanin (resp. bounded fanin) circuit of depth 
(logn)'^ is AC°-complete for AC*' (resp. NC'^). Unfortunately these nonrel- 
ativized problems are not AC°(a)-complete for the corresponding relativized 
problems, unlike the situation for the classes with bounded oracle nested depth 
considered previously. However for the oracle versions of the circuit classes, the 
evaluation problems become AC'^-complete for the corresponding relativized 
classes, provided (in the case of NC*') the circuit descriptions tell the nested 
oracle depth of each oracle gate. Thus VAC*' (a) (or VNC'^(a)) will be ax- 
iomatized by V*^ together with an additional axiom that formalizes an oracle 
computation that solves the respective complete problem. 

First we describe the encoding of the input. As before, a circuit of width w 
and depth d will be encoded by {w,d,E,G), and its input will be denoted by 
I. Since the order of inputs to an oracle gate is important, the string variable 
E that encodes the wires in the circuit is now four-dimensional: E[z,u,t,x) 
indicates that gate {z, u) (i.e. the w-th gate on layer z) is the t-th input to gate 
(z + Also, the type of a gate (z,x) is specified by (G)^^'^^ as before, but 

now it can have value in A, V, or a (we no longer consider just monotone 
circuits). We use the following formula to ensure that this is a valid encoding; 
it says that each gate (z + l,x) has an arity s which is 1 if the gate is a -i-gate. 
Moreover for i < s the t-th input to a gate is unique. 

Proper{w, d, E, G) =Vz < dix < w3\s < w{s > 1 A Arity{z + 1, x, s, E))A 

where Arity{z + 1, x, s, E) (which asserts that gate {z + 1, x) has arity s) is the 
formula: 

< s3!u < w E{z, u, t, x) A\/t < w{s <tD -'Bu < wE{z, u, t, x)) (22) 

The formula Slocvi'^^ ^' ^) defined below states that (Q, Y) is an 

evaluation of the oracle circuit (w, d, E, G) on input /. Here the string QI^+^'^I 
encodes the query to the oracle gate {z + l,x) and bit Y{z,x) is the value of 
gate {z,x). (LOCV stand for "layered oracle circuit value.") 

Definition 28. The formula ^"ocy *3' ^) formula 

\/z<dix< w, [y(0, x) -H- I{x)]A 

[Vt < u;(Ql^+^'^l(i) o (3u < w, E{z,u,t,x) hY{z,u)))\ A 
\Y{z + l,x) o (((G)<^+^'^> = "A"AVi,M < w, E{z,u,t,x) DY{z,u))y 
((G)<^+^'^> = 'V"A3t<w3u<w, E{z,u,t,x)AY{z,u))V 
^^Q^{z+i,x) ^ "-^"A3u<w, E{z,u,0,x) A^Y{z,u))\/ 

((G)<^+i'^> = "a"Aa(g[^+i'^])))] 

Definition 29 (VAC*'(a)). For k>l, VAC''(a) is the theory over the vocab- 
ulary jC\{a) and is axiomatized by the axioms o/ V*' and the following axiom: 

{Proper{w,d,E,G) D3Q3Y S2mcv{w,\w\^E,G,I,Q,Y)) (23) 
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The axiom asserts that VAC'^ circuits can be evaluated. Since a func- 
tion in FAC'^(a) is computed by an AC°-uniform family of AC'^(a) circuits, 
and our method of describing an oracle circuit by the tuple (w, d, E, G) can 
be taken as a definition, the axiom is clearly strong enough to show that the 
functions in FAC'^(a) are Sf (a)-definable in VAC''(a). But in order to show 
the converse we need to show that the existential quantifiers 3Q3Y can be wit- 
nessed by functions in FAC'^(a), and for this we need to show the existence of 
universal circuits for AC'^{a). This is done in the next result. 

Proposition 30. For k > 1, the problem of evaluating the circuit encoded by 
(w, \w\'',E,G) on a given input I, assuming Proper{w, \w\'^,E,G) is satisfied, 
is complete for FAC^ (a) under AC^ -many-one reductions. 

Proof. The hardness direction follows by the discussion above: Every function 
F{X) inFAC'=(a) can be computed by a circuit family in which the parameters 
w, E, G, I for each circuit can be computed by AC" functions of X. 

Conversely we need to prove membership of the circuit evaluation problem 
in FAC''(a). We do this for the case k = 1. The proof for the general case 
is similar. Thus we need to construct a universal circuit for oracle circuits of 
depth logn. In fact, we will construct a universal circuit (of depth 0{d), size 
polynomial in w, d) for all circuits of depth d and width w. Let G = {w, d, E, G) 
denote the given circuit. The idea is to construct a component Kz^x for each 
gate (z, x) in C, where z < d and x < w: Kz+i.x is an AC*' (a) circuit that takes 
inputs from E, G, I and Kz^u for all u < w, so that when each Kz,u computes 
gate {z,u) in C, Kz+i,x computes the value of gate {z -\- l,x). We will present 
Kz.x as a bounded depth formula. 

The circuits Kq x are easy to define: for all x < w, Kq x = I{x). For z > 0, 
Kz+i^x is the following disjunction: 

(g,){.-hi..> ^ a^„ A /\ /\ Eiz,u,t,x) D Kz^uV 

^ u^,,^ y y E{z,u,t,x)AKz,u^ 
(G)<^+i'"> = "-"A V E{z,u,Q,x)h^Kz,uy 

{Arity{z, X, s, E)Aa{ \/ {E{z, u, 0, x)AKz.u), • ■ • , V 

Now by arranging Kz.x in the same order as (z, x) we obtain an AC^{a) circuit 
that evaluates C. □ 

Theorem 31. For k > 1, the functions in FAC'^(q!) are precis ely the Sf (a)- 
definable functions o/VAC'^(a). 
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Proof. By Proposition [3D] the problem of witnessing the quantifiers 3Q3Y in 
the axiom (|23|) is in FAC'^(a), and so by a standard witnessing argument every 
Sf^(a)-definable function is in FAC'=(a). The converse follows from the hard- 
ness direction of PropositionlSOland the fact that the Sf (a)-definable functions 
in VAC'^(a) are closed under AC°-reductions, by the methods used in Chapter 
IX of |CN10) . □ 

Finally we consider NC'^(a) classes for k >2. To specify an NC'''(q) circuit, 
we need to express the condition that A and V gates have fanin 2. We use the 
following formula Fanin2'{w,d,E,G) to express this, see also (P^: 

Vz < dVx < w, ((G)<^'^> ^ "a" A (G)<^'^> D Arity{z,x,2,E) 

Moreover the nested depth of oracle gates in circuit {w, d, E, G) needs to be 
bounded separately from the circuit depth d. We use a formula ODepthf. {w,d,E,G, D) 
which states that this nested depth is bounded by \'w\'' . Here the extra string 
variable D is to compute the nested depth of oracle gate: D is viewed as a se- 
quence, where (D)^^'^^ is the oracle depth of gate {z,x). (Recall that the gates 
(0,x) are input gates.) The sequence is computed inductively, starting with the 
input gates. An explicit formulation is rather straightforward but tedious, so 
we omit the details here. Note that we can use AC° number functions such 
as \x\ and max (which returns the maximum element in a bounded sequence), 
because they can be eliminated, see |CN101 Lemma V.6.7]. 

Definition 32 (VNC''^(a)). For k > 2, VNC''(a) is the theory over C\{a) 
and is axiomatized by V*^ and the axiom 

[Proper{w, d, E) A Fanin2'{w, \w\'',E, G)A 

ODepthk_^{w,d,E,G,D)] D 3Q3Y Slocvi^Awl'' , E,GJ,Q,Y) (24) 

Proposition 33. For k > 2, the problem of witnessing the quantifiers 3Q3Y 
in the axiom for VNC'' (a) is complete for NC'^(a) under AC'^ -many-one re- 
ductions. 

First we exhibit a problem complete under AC°-reductions for NC"'^(q!). 
Informally, this is the problem of evaluating a relativized sentence which is given 
using the extended connection language [RuzSlj . More precisely, we consider 
encoding relativized sentences by tuples (a, G, /, J) in the following way. The 
sentence is viewed as a balanced binary tree as in the axiom MFV pH]) . but 
now each leaf Y(x -\- a) can be an input bit (from /) or (the negation of) an 
a-gate that takes its input from J. In other words, the underlying circuit for 
the sentence has exactly one layer of oracle gates which take input directly from 
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the input constants. More precisely, let 

6{a, G, /, J, r) = Vx < a, G{x + a) = "a" D {Y{x + a) o a( j'"^')) A 
G{x + a) = "^a" D + a) ^ ^a(j[^l)) A 

G(x + a) = "const" D + a) o /(x)) A 
0<a; D o ((G(x) Ar(2x)Ar(2x + l))v 

(-G(a;) A {Y{2x) V y(2a; + 1)))) 

In the next result we emphasize that the AC"-reductions referred to are the 
'Turing' reductions given in Definition 1231 

Lemma 34. The relation given by the formula 3Y{5{a,G, I, J,Y) A Y{1)) is 
AC° -complete for NC^a). 

Proof. For the hardness direction we note that the circuits solving a problem 
in NC^(a) have oracle nested depth bounded by some constant d. Hence such 
a circuit can be simulated by d circuits of the form described above, forming d 
layers. The layers can be evaluated by d successive queries to the relation in 
the lemma, where in each layer except the first, the constant inputs / and the 
oracle inputs J are determined by the gate values in the previous layer. 

For membership in NC^(a), observe that we can evaluate the first layer of 
the circuit by an AC" (a) circuit (see also the proof of Proposition [501) • Once 
this has been done, the remaining task is to evaluate a nonrelativized, balanced, 
monotone boolean sentence, which can be done by an NC^ circuit. □ 

Proof outline of Proposition \33[ The hardness direction is proved as for Propo- 
sition [30j We assume that by definition an NC'^(a)-circuit must satisfy the 
hypotheses of the axiom ([M)) . 

Now we argue that the problem actually belongs to NC'^(q!). Consider the 
case A; = 2; other cases are similar. First, the given problem reduces to the 
following restriction of it, called P, where the layers in the given circuit are 
grouped together to form \w\ many blocks _Bi, i?2, . . . , -B|to|, where each block 
Bi has exactly \w\ layers and w outputs. Furthermore, each block is an 
circuit (with multiple outputs) such that all a-gates appear in the first layer. 
Moreover, these NC'^(a) circuits are presented using the extended connection 
language. The reduction can be done by uniform circuits of polynomial size, 
log log n depth and unbounded fanin, where n is the length of the input to our 
original problem. 

It remains to show that the new problem P is solvable by a uniform family 
of NC^(a) circuits. Note that the input now can be viewed as the sequence 

Pi, i?2, . . . , P|to| 

where each Bi consists of w single-output NC^(q!) circuits 

Bi^i, Pi,2, • ■ • , Bi^uj 
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Here each Bij is an NC (a) circuit where aU a-gates are on the first layer. 
Lemma [34] above shows that each Bij can be evaluated by an NC^(a) circuit 
Cij. As a result, the circuits for solving P are obtained by arranging Cij 
appropriately. □ 

The next theorem is proved in the same way as Theorem [311 using Proposi- 
tion [33l 

Theorem 35. For k > 2, the functions in FNC'^(q!) are precis ely the Sf (a)- 
definable functions o/VNC''(a). 

Now we can apply the separations of the relativized classes obtained in Sec- 
tion [3] to prove separations of the corresponding theories. 

Corollary 36. VL{a) C VAC^(a), and for k > I: 

VAC^{a) C VNC'^'+^a) C VAC'^'+i(a) 

Proof. The first inclusion follows from Proposition [571 ^nd the fact that the ax- 
iom PATH {a) is implied by the axiom for VAC^a). The remaining inclusions 
are easy to check, so it suffices to show the strictness of the strict inclusions. 
By Theorems [211 [311 and [551 we know that the Sf (a)-definable functions in 
each theory are those in the corresponding complexity class. By Corollary [191 
we know that the inclusions of the corresponding complexity classes are strict, 
where indicated in the statement of the corollary. □ 



5 Conclusion 

The the relativized class AC''(a), fc > 0, has an obvious definition: treat an 
oracle gate a(xi, . . . , a;„) in the same way as A and V gates. However definitions 
of the relativized versions of the classes NC*", L, and NL are not so obvious. 
Here we give new definitions for these classes that preserve many of the prop- 
erties of the unrelativized classes, namely class inclusions, Savitch's Theorem, 
and the Immcrman-Szelepcsenyi Theorem. However there is a weakness in our 
definition of csNL(q!) (relatived NL), namely the corresponding function class 
may not be closed under composition (all other function classes are so closed). 
A possible way out is to define relativized NL to be AC°(STCONN, a) (see 
Theorem [51 part (ii) and its proof). This class has nice closure properties and 
satisfies the expected inclusions with other relativized classes. It also has a nat- 
ural associated relativized theory, namely VNL'(a) (see Definition [25]) . But we 
do not know how to define AC°(STCONN, a) in terms of nondeterministic log 
space oracle Turing machines. We leave this conundrum as an open problem. 

We note that the first author has carried out in [AehlOj a detailed study of 
propositional versions of our relativized theories. 
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